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Abstract 

Let {Bt)o<t<T be either a Bernoulli random walk or a Brownian motion 
with drift, and let Mt := ma^{Bs : < s < t}, < t < T. This paper 
solves the general optimal prediction problem 

sup E[/(A/t-SO], 

0<T<T 

where the supremum is over all stopping times r adapted to the natural 
filtration of (Bt), and / is a nonincreasing convex function. The optimal 
stopping time r* is shown to be of "bang-bang" type: r* = if the 
drift of the underlying process (Bt) is negative, and r* = T is the drift 
is positive. This result generalizes recent findings by S. Yam, S. Yung 
and W. Zhou [J. Appl. Probab. 46 (2009), 651-668] and J. Du Toit 
and G. Peskir [Ann. Appl. Probab. 19 (2009), 983-1014], and provides 
additional mathematical justification for the dictum in finance that one 
should sell bad stocks immediately, but keep good ones as long as possible. 
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1 Introduction and main results 

A number of recent papers (e.g. [I] SI [5]) have discussed the problem of stopping 
a random walk, or a Brownian motion, "as close as possible" to its ultimate 
maximum. An important motivation in these papers was the financial problem 
of selling a stock at a price "close" to the highest price over a given finite time 
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interval, when the stock price follows a discrete binomial model (in [5]) or a 
geometric Brownian motion (in [Tl|4]). In these three papers, "closeness" was 
measured by the ratio of the stopped price to the ultimate maximum price, 
and the striking result was that the optimal strategy is of "bang-bang" type, 
meaning that it is either optimal to stop at time zero, or to stop at the time 
horizon, depending on the quality of the stock. These results, as pointed out 
by the papers' authors, reinforce the widely held financial view that one should 
sell bad stocks quickly, but keep good ones as long as possible. 

The purpose of the present paper is to provide an important generalization 
of the results in [1] [S]. Rather than considering price ratios, we take as the 
basic process either a "flat" Bernoulli random walk or a Brownian motion with 
drift, and measure closeness by a general nonincreasing, convex function / of the 
positive distance from the stopped value of the process to its eventual maximum. 
For this more general problem we obtain the same result, namely that it is either 
optimal to stop at time zero or at the time horizon, depending on the drift of 
the underlying process. For the specific function f{x) = e~'^^, where cr > 0, 
our results reduce to those of [T] and [S] . The proofs involve only a minimum of 
technicalities, and bring to the foreground the essential feature hidden within 
the arguments in the aforementioned papers, namely convexity of the function 

/■ 

The remainder of this section is devoted to a precise formulation of the 
problem and statements of the main results, which are nontechnical in nature. 
First, let {5'„}„=o,i,... be a Bernoulli random walk with parameter p S (0,1). 
That is, 5*0 = 0, and for n > 1, Sn = Xi + ■ ■ ■ + Xn, where Xi,X2, ■ ■ ■ are 
independent, identically distributed random variables with P(Xi — 1) = p, and 
P{Xi = —1) = q := 1 — p. Let a finite time horizon £ IN be given. Let 
/ : {0,1,..., iV} ^ IR be nonincreasing, and consider the optimal stopping 
problem 

sup nf{MN~Sr)l (1.1) 
0<r<Af 

where Mpf := max{5'o. Si, . . . , Sn}, and the supremum is over the set of all 
stopping times t < N adapted to the natural filtration {J-k}o<k<N of the process 

{5'fc}o<fc<Af- 

As a concrete example, taking /(O) = 1 and f{k) = for fc > 1 turns the 
expectation in (jl.ip into the probability P{St = Mn), so that ()l.ip becomes 
a "best-choice" or "secretary" problem for the random walk, where the goal is 
to maximize the probability of stopping at the ultimate maximum of the walk; 
see [5] , where this problem is solved in a somewhat more general setting for the 
case p = 1/2. Yam et al. [5] solved the problem for arbitrary p, and showed 
the (unique) optimal rule to be t = when p < 1/2, and t = n when p > 1/2. 
When p — 1/2, it is optimal to stop at time 0, or at time N, or at any time 
at which the walk is at its running maximum. (A similar problem, where the 
objective is to stop a Brownian motion within a distance e > from its ultimate 
maximum, was considered in [3].) 

Yam et al. [5] also treated the case /(fc) = d'^, where < d < 1 is a constant. 
They showed that for this quite different objective function, the optimal rule is 
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nonetheless exactly the same as for the problem of maximizing the probability 
of stopping at the maximum. 

This leads one to believe that there must be some general principle at work. 
Notice that in each of the above examples, / is in fact convex. The first aim of 
this note is to show that the optimal rule is of the above simple form for any 
nonincreasing convex objective function /, thereby generalizing the results of 
[g. Recall that a function / : {0, 1, . . . , iV} ^ R is convex if f{k) - 2f{k + 1) + 
f{k + 2) > for all k with < A; < — 2, and is strictly convex if the inequality 
is strict for all such k. 

Theorem 1.1. Let f : {0, 1, . . . , iV} ^ IR 6e nonincreasing and convex, and 
consider the optimal stopping problem (jl.ip . 

(i) If p < 1/2, the rule t = is optimal. 

(ii) If p > 1/2, the rule t = N is optimal. 

(Hi) If p = 1/2, any stopping time r satisfying Sr — or t ^ N almost 
surely is optimal. 

Thus, in the words of Du Toit and Peskir P^, the optimal strategy t* is of 
"bang-bang" type: r* = if p < 1/2, and r* = if p > 1/2. 
Convexity of / is essential, as the following example shows. 

Example 1.1. Let /(O) = /(I) = 1, and f{k) = for fc > 2. Thus, there 
are two possible outcomes, "winning" and "losing" , and we win if we stop with 
one of the two highest values of the walk. Let N — 2. It is easy to see that, 
regardless of p, the rule r = 1 gives a winning probability of 1. On the other 
hand, the winning probability for the rule r = is 1 — p^, and that for the rule 
T = 2 is 1 - 

One might ask when the optimal rules in Theorem 1 1.1 1 are unique. The next 
theorem gives simple sufficient conditions to this effect. 

Theorem 1.2. Let f be as in Theorem \l.l\ 

(i) If p < 1/2 and f is nonconstant, then the rule t = is the unique optimal 
rule. 

(ii) If p > 1/2 and f is strictly decreasing, then the rule t = N is the unique 
optimal rule. 

(Hi) If p — 1/2 and f is strictly convex, then the only optimal rules are those 
that satisfy Sr = or t ^ N almost surely. 

It is left to the interested reader to verify that the above conditions can not 
be substantially weakened. 

Next, let B := {Bt)t>o be a standard Brownian motion, and A a real param- 
eter. Then the process iB^)t>Q defined by B^ := Bt + Xt is a Brownian motion 
with drift A. Let M^ :— max{i3^ : < s < <}. Once again we are interested in 
finding a stopping time r (with respect to the natural filtration [J-^)^^^^ of B) 
that will attain the maximum in 

sup E[/(M^-i3^)], (1.2) 

0<r<T 
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where / : [0, oo) H is a given (reward) function, and T > a fixed time 
horizon. Note that in particular, the choice f{x) = e~'^^ for a constant cr > 
yields the problem studied in [3] and in Section 4 of [T]. 

Since Brownian motion is the scaling limit of Bernoulli random walk, one 
might expect the result to be the same as in Theorem 11.11 This is indeed the 
case, except that the conditions for uniqueness of the optimal rules are weaker. 

Theorem 1.3. Let f : [0, oo) — > IR &e non-constant, nonincreasing and convex, 
and consider the optimal stopping problem (|1.2p . 

(i) If X <0, the rule t = is the unique optimal rule. 

(a) If X> 0, the rule t = T is the unique optimal rule. 

(Hi) If X = 0, any stopping time t satisfying 

F{B^ ^ orr^T)^! (1.3) 

is optimal. (In particular, the rules r = and t = T are optimal.) If further- 
more, f is not linear, then all optimal rules satisfy (|1.3p . 

Note that if / is constant, or if / is linear and A = 0, then any stopping 
time is optimal in view of the optional sampling theorem. Thus, the uniqueness 
conditions in Theorem 11.31 are the best possible. Essentially, the conditions for 
uniqueness of the optimal rules are weaker than in the discrete case because the 
increments of Brownian motion can be arbitrarily large, whereas the increments 
of Bernoulli random walk are bounded. 

Finally, we note that by putting / := — /, problems (11.11) and p.2|) may be 
formulated equivalently as penalty-minimization problems. For instance, (|1.2p 
can be represented alternatively in the form 

^mf^E[/(M^^-i?^)], (1.4) 

where / : [0, oo) — > K is nondecreasing and concave. Thus, the above results 
apply to a variety of natural penalty functions, including f{x) — x" where 
< a < 1, f{x) = log(l -l-a;), etc. However, without concavity of / the optimal 
rules are generally of a more intricate form: see, for instance, the solution in [H 
Section 3] of (|1.4p for the function f{x) — e"'^, where cr > 0. 

Theorems 11.11 and 11.21 are proved in Section [21 and Theorem 11.31 is proved 
in Section [3l Many of the ideas of the proofs are adapted from Ij and [5] , 
and some details, in as far as they can be found in these papers, are therefore 
omitted here. The novel contributions of the present article are the explicit use 
of the convexity of / (see Lemmas 12.11 and 13.11 below), and the investigation 
of uniqueness of the optimal stopping times, which requires some finesse in the 
case of general /. 

2 The maximum of Bernoulli random walk 

This section is devoted to the proofs of Theorems 11.11 and 11.21 It will be useful 
to consider an infinite family of random walks, defined on the same probability 
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space. The following construction is standard. Let Ui,U2 ■ ■ ■ be independent 
random variables, uniformly distributed on the interval [0,1]. For fc G IN and 
p G (0, 1), define 




1, if C/fc < p 
-1, \iUk>p. 



Define = 0, and Si := + ■ ■ ■ + X'^, for fc > 1. Then for each p e (0, 1), 
{•^fclfc ^ Bernoulli random walk with parameter p. And if p > p', then 
> X( for all k. 

Let Ml max{5g', . . . , S^, and Zl := - S^, for fc = 0, 1 . . . . Observe 
that for eachp, the process {Zl}f^ is Markovian. Moreover, it is easy to see that 

p>p' ^ Zl< Zl' for aU k. (2.1) 

Finally, and most importantly, Bernoulli random walk satisfies the well-known 
refiection property 

{MP-SP,SP)^{M^,-S?,) (2.2) 

for all n G IN. (The easiest way to see this is to observe that the time-reversed 
process Sk ■— Sl^_^ — S^, k — 0,1,..., n is a Bernoulli random walk with 
parameter q, starting at and ending at —S^, with maximum value — 5*J.) 
In particular (reversing the roles of p and q) , 

MP £ M^ -Sl^ Zl. (2.3) 

It is almost amusing to see how many times this identity must be used in order 
to prove Theorem ll.il 

The following lemma holds the key to the proof of Theorem 11.11 

Lemma 2.1. LeA f : {0, 1, . . . , N} — ^ IR 6e nonincreasing and convex. 

(i) Ifp > 1/2, then 

E[/(z V MP - SP)] > E [/(z V {MP - SP))] (2.4) 

for all n < N and all i > 0. 

(ii) If p > 1/2 and f is strictly decreasing, then strict inequality holds in 
([231) for alio <n<N and all i > 0. 

(Hi) If p > 1/2 and f is strictly convex, then strict inequality holds in p.4p 
for all < n < N and all i > 0. 

Proof, (i) Let p> 1/2. We begin by writing 

E [fit V MP - SP) - /(* V {MP - SP))] 

= E E V fc - - /(* V (fc - 0)] PiMP = fc, SP = I) 

IGZ k>l 

-EE+EE-^" + ^-- 

;>0 k>l KO k>0 
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(Note that the terms with I = vanish.) By (|2.2p and the change of variable 
k' = k — I, I' = ~l, the second summation becomes 

=J2Y. V fc - /) - /(* V (fc - /))] P(Af,^ = k-l, 5,1 = -0 
(<o fe>o 

= E E V (fc' - n + 1') - f{i V k')] = fc', si = r). 

The key to further progress is that for Z > 0, 

P(M^ = fc, 5,^ = > P(A^,^ ^KSl = I). 

(This foUows easily by considering the probability of a single path ending at / 
with maximum k.) Since / is nonincreasing and iW k ^ I < i\/ {k — I), we have 

f{iV k-l)- f{iV (k-l)) >0, 

and therefore, 

s+ > E E vk-i)-f{tw{k- 1))] p(m;j = k, SI = I). (2.5) 

;>o k>i 

Combining these results, we conclude that 

S+ + > E E ^(*' ^' PiM?, - fc, 5,", - I), (2.6) 
;>o fe>i 

where 

^(i, A:,0 : = [/(i V fc - - /(* V (fc - /))] + [f{t V {k - I) + I) - f{i V k)] 

= [/(zvfc-0-/(*vfc)]- [/(zv(fc-O) - /(iv(fc-O + 0]- 

Since iVk — l<i\/{k — I) and / is convex, it is easy to see that k, I) > 0. 
This yields (j^ . 

(ii) Suppose p > 1/2 and / is strictly decreasing. Let n > and i > 0, and 
put k = I = n. Then 

/(* V fc - - /(* V (fc - 0) = /((* - n)+) - fit) > 0. 

Since P(MP = 5^ = n) > P(Af« = 5* = n), strict inequality holds in (g^]), and 
hence in (|2.4p . 

(iii) Finally, suppose p > 1/2 and / is strictly convex. Let n > and 
i > 0. Since iW n — n ~ [i — n)+ < i = i V (n — n), the strict convexity of / 
implies that ipii.rijn) > 0. This, together with (|2.6p and the obvious fact that 
P(M9 = 5? = n) > 0, gives strict inequahty in (|T4)) . □ 

Corollary 2.1. Lei / 6e as in Lemma [2A[ If p > 1/2, then 

E[/(zVM^-5^)]>E[/(zVM^)] (2.7) 

/or all n < N and all i > 0. Moreover, if p > 1/2 and f is strictly decreasing, 
then strict inequality holds in (12. 7|) for all < n < N and all i > 0. 
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Proof. Let p > 1/2. Note that in view of (|2.'2p . the inequality (|2.4p can be 
stated alternatively as 

E[f{zWMP-SP)]>nf{tWM?,)]. (2.8) 

Since < and / is nonincreasing, we have furthermore 

E[/(*VAf„^)]>E[/(zVA/^)]. (2.9) 

This, together with (j^ . gives (P??)) . 

Now suppose p > 1/2 and / is strictly decreasing. By Lemma [2.1f ii'). it 
suffices to verify strict inequality for i = 0. But for this value of i, (|2.9p holds 
with strict inequahty, since P(M« < MP) > for n > 0. □ 

Proof of Theorem ] 1.1[ Define the cr-algebras J-k ■= (j{{Ui, . . . ,Uk}), for k = 
0,1, ... ,N. We prove the slightly stronger statement that, even among stopping 
rules that can use complete information about the J/^'s, the rules given in the 
statement of the theorem are optimal. Recall that, for a stopping time r adapted 
to {^fe}, the sigma algebra J^r is defined by the rule 

A e Tr ^ An {t < k} e Tk for all k. 

(i) Consider first the case p < 1/2. The argument below is adapted from 
[S]. Let T be a stopping time adapted to {J'k}- By conditioning on J>, we can 
write 

E[/(M^-5?)]-E[G(7V-r,Z?)], 

where 

Gik,i):=nfiiW MP)]. (2.10) 

Using (j2.3p and the stationary and independent increments of the random walk, 
we obtain similarly 

E[/(M^)] = E[/(Z^)] = E[E[/(Z^)|^.]] = E[D{N ~ r, Z!^)], 

where 

D{k,z) ■.= E[f{zyM^^-Sl)]. 

(See [5], p. 654 and p. 660 for the details of these calculations in the case 
f{k) = e~^'' .) Since / is nonincreasing, G{k, i) is nonincreasing in i for fixed k, 
which by jn]) imphes that G{N - r, ZP) < G{N - t, Z«). But by (EH) with 
the roles of p and q reversed, 

D{k,i) > G{k,i) 

for all k and all i. It follows that 

E[/(A./^ - SP)] = E[G(7V - r, Z^)] < E[G{N - r, Z^,)] (2.11) 
<E[i^(7V-r,Z^)] =E[/(M^)], 
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for any stopping time r. Thus, the rule r = is optimal. 

(ii) Assume next that p > 1/2. Define G{k,i) by (|2.10p . and let 

By Corollarv l2.11 D{k, i) > G{k, i), and hence, for any stopping time t, 

E[/(M^ - SP)] = E[G(7V - r, Z^)] < E[D{N - r, Z^)] (2.12) 
= E[/(Z^)]=E[/(M^-5P)]. 

Therefore, the rule r = iV is optimal. 

(iii) Consider finally the case p = 1/2. Observe that G(0, i) = D{0, i) = f{i) 
for aU i, and G(fc,0) = E[/(MP)] = E[f{Zl)] = D{k,0) for aU k. Thus, for any 
stopping time r with St = Mr or t — N almost surely, 

G{N - T, ZP) = D{N - T, ZP) = D{N - t, Z«) 

(since p = q), and hence, for any such t, 

E[/(MP - SP)] - E[/(M^)] = supE[/(MP - Sr')], (2.13) 

r' 

where the last equality follows by part (i). □ 

Proof of Theorem M.SX (i) Let p < 1/2, and suppose / is not constant. Since / is 
nonincreasing and convex, this implies that /(O) > f{i) for all z > 0. It follows 
that G(fc, 0) > G(fc, i) for aU i > and aU k, since obviously /(Af^?) > f{i\/MP), 
and 

P [f{MP) > /(* V MP)] > PiMP = 0) > 0. 
Now consider a stopping time r with r > 0. Then 

P(Z« = 0, > 0) > P(Z^ = and > for k = l,...,N) 

> PiXl = 1 and XP = -1 for A: = 1, ... , iV) 
= (g-p)^>0. 

(Note that this holds for any random time r, not just for stopping times.) 
It therefore follows that E[G(7V - t, Z^)] > E[G{N - t,Zp)], which is strict 
inequality in (|2.1ip . 

(ii) Suppose next that p > 1/2 and / is strictly decreasing. Then strict 
inequality holds in Corollary 12.11 for n > and all i. But this yields strict 
inequality in (j2.12|l for any stopping time t with P(t < N) > 0. 

(iii) Finally, assume p = 1/2, and let / be strictly convex. If = 1, the 
only stopping times are r = and r = 1, which both satisfy the condition in 
Theorem II. If iii V So assume N >2. By Lemma [5TTJiii), strict inequality holds 
in (12. 4p for all i > 0. Thus, if r is a stopping time with the property that 
P{MP - SP > and T < N) > 0, then 

E[D{N~T,ZP)]>E[G{N-T,ZP)], 

and so the first equality in (|2.13p is replaced with "<" . □ 
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3 The maximum of Brownian motion 

The key to the proof of Theorem 11.31 is the foUowing analog of Lemma 12.11 It 
makes use of the well-known fact, analogous to (|2.2p . that 

{M,^ - Bl Bl) i {M-\ -B-^). (3.1) 

Lemma 3.1. Let f : [0, co) -^TR be nonincreasing and convex. 

(i) IfX>0, then 

E [fix V M,^ - B^)] > E [f{x V {M,^ - B^))] (3.2) 

for all t > and all x > 0. 

(ii) If X > and f is not constant, then strict inequality holds in (j3.2p for 
all t > and all x > 0. 

(Hi) If X = and f is not linear, then strict inequality holds in p.2[) for all 
t > and all X > 0. 

Proof, (i) The inequality is trivial when t = 0, so assume t > 0. Let h{s, b; X) be 
the joint density function of {M^,B^). Note that in view of (|3.ip . or by p.4p 
below, 

h{s,b;X) ^ h{s -b,-b;-X). (3.3) 
As in the proof of Lemma l2.11 we begin by writing 

E [fix V M,^ - Bi) - f{x V iM^ - B^))] 

= I I [fixV s-b)- f{xV is~b))]his,b-,X)dsdb 

JbeM Js>b 

-I j I 

Jb>0Js>b Jb<0Js>Q 

Using (|3.3p and the change of variable z = s — b, b' = —5, we can write /~ as 
r = [ [ [f{x\/ iz-b') + b') - fixV z)]hiz,b';-X)dzdb' 

Jb'>Q Jz>b' 

= / / [f{x\/ is-b) + b) - fixV s)]his,b;-X)dsdb, 

Jb>0 Js>b 

where the last equality follows simply by renaming the variables. Recall (see, 
e.g., equation (3.2) of Ij) that for fixed t, his, b; X) is given by the formula 

his, b; X) = . /l!l_^e-(2.-^)'/2*e^(^-^*/2) (3.4) 

for all s > and b < s. It follows that for all 6 > and s > b, 

his, b; X) > his, b; —A), 
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with strict inequality if A > 0. (Note that there does not seem to be a direct 
probabilistic argument for this last inequality; instead, we must rely on the 
specific form of the density formula p.4p .) Since / is nonincreasing and x\/s—b < 
xW {s ~ b) for 6 > 0, we have 

/(xVs-6)-/(xV(s-6)) >0, for6>0. 

Thus, 

/+ > /" [ [f{xy s-b)- f{x\/ {s-b))]h{s,b;-X)dsdb. (3.5) 

Jb>0 Js>b 

Putting these results together, we conclude that 

/++/->/" [ i:{x,s,b)h{s,b;-X)dsdb, (3.6) 

Jb>0 J s>b 

where 

^{x, s, b) := f{x\f s-b)- f{x V (s - b)) + f{x V (s - 6) + 6) - f{x V s). 

As in the proof of Lemma [2.11 the convexity of / implies ip{x, s, b) > 0. Thus, 
the proof of p.2p is complete. 

(ii) Suppose now that A > and / is not constant. Fix a; > 0. Since / 
is nonincreasing and convex, we can choose (5 > so small that 2S < x, and 
f{2S) > f{x). But then, on the small square x — d<b<x<s<x + 5,we have 

f{xys-b)- f{x V (s - b)) - f{s -b)- fix) > f{25) - fix) > 0. 

Since h{s, b; A) > h{s, b\ —A) on this small square, strict inequality results in 
(|33)) . and hence in ((372)) . 

(iii) Suppose finally that A = and / is not linear. Then there exists a point 
a;o > such that for all x > xq and all u > 0, /(O) — f{u) > f{x) — f{x + u). 
Choose n G INf such that nx > xq. Then for s — b — nx, ^{x,s,b) — /(O) — 
f{x) + f({n + l)x) — f{nx) > 0. By continuity of V', it follows that > on 
a small square of positive h{s, b; — A)-density. Putting this back in p.6p gives 
strict inequality in (|3.2p . □ 

Corollary 3.1. Let f be as in Leinma [37l[ If X>0, then 

E[f{x V M,^ - B^)] > E[fix V M,^)] (3.7) 

for all t > and all x > 0. Moreover, if X > and f is not constant, then strict 
inequality holds in (|3.7p for all t > and all x > 0. 

Proof. Let A > 0. In view of p.ip . the inequality (|3.2p is equivalent to 

E[/(x V M,^ ~ B^)] > E[f{x V (3.8) 
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(Note that (|3.8p generalizes the key inequahty (4.28) in [T].) Since 
and / is nonincrcasing, we have 

E[/(x V M-^)] > E[/(x V Af,^)]. (3.9) 

This, together with gives 

Now suppose that A > and / is not constant. By Lemma ISTlT ii). it sufSces 
to verify strict inequahty for x — 0. Since / is nonincreasing and convex, there 
exists xq > such that / is strictly decreasing on [0, xq]. Clearly, F{M^^ < 
< xq) > for t > 0. As a result, strict inequality holds in (13. 9p for 
X = 0. □ 

Proof of Theorem \1.3l a) Optimality. We first prove that the rules given in the 
statement of the theorem are optimal. Let 

Z,^ M,^ ~ Bl t > 0, 

and note that for fixed t, is pointwisc nonincrcasing in A. 

(i) Assume first that A < 0. Define the functions 

Git,x) ■.= E[fixVMt% D{t,x) :=E[/(xVMr^-i?r^)]. 

Let r < r be any stopping time adapted to the filtration {J^P). As in the proof 
of Theorem 11.11 we have 

nf{M^^B^)]=E[GiT-T,Z^)]. 

Using (|3.ip . the stationary and independent increments of Brownian motion and 
the strong Markov property of the process (Zt), we obtain 

E[/(M^)] = E[fiZ^^)] = E[D{T - T, Z-% 

(For the details of these calculations, see [T], p. 987 and p. 1004.) Since 
/ is nonincreasing, G{t, x) is nonincreasing in x for fixed t. It follows that 
G(T - r, Z^) < G{T - r, Z'^). Furthermore, JSH) with A replaced by -A gives 
Z)(i, a;) > G{t, x), for all t and all x. As a result, 

E[/(a4 - B^)] = E[G(T - T, Z^)] < E[G(T - r, Z;^)] (3.10) 
< E[D{T - T, Z-^)] = E[/(A/^)]. (3.11) 

Since this holds for any stopping time r, it follows that the rule r = is optimal. 

(ii) Consider next the case A > 0. Let 

Dit,x) :=E[/(xVAf,^-B,^)]. 

Then CoroUarv 13.11 implies that D{t,x) > G{t,x), and hence, 

E[/(M^ - B^)] = E[G(r - T, Z^)] < E[^(r - T, Z^)] (3.12) 
= E[/(Z^)] = E[f{A4 - B^)] 
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for any stopping time r. Thus, the rule r = T is optimal. 

(iii) Suppose finally that A = 0. Then G{0, x) = D{0, x) for all x, and 
G{t,0) — D{t,0) for all t. Thus, for any stopping time r satisfying p.3p . 



G(T - r, Z^) = D{T - r, Z^) = D{T - r, Z"^), 
so that (see ((XTU)) and ([XTT1) ) 

E[/(A4-i3^)]-E[/(A4)]. (3.13) 
By part (i) of the theorem, this implies that t is optimal. 

b) Uniqueness. We next verify the uniqueness claims in Theorem 11.31 

(i) Assume first that A < 0. While Lemma |3 . 1 1 provides strict inequality in 
(|3.1ip for the majority of stopping times, it does not do so for stopping times 
T of the form p.3p . Therefore, we establish strict inequality in p.lOp instead. 
First, since / is non-constant, nonincreasing and convex, there exists a point 
xq > such that / is strictly decreasing on [0,xo]. It is easy to see that the 
same is then true for G{t, •) for any fixed t, including t = 0. Let t < T be a 
stopping time with P(r > 0) > 0. We show first that 

P(0 <Zr< xo) > 0, (3.14) 

where we write Zt for Z^. Choose io > so that P(r > to) > 0, and let 

To := min{to,r(xo/2)}, 

where t{x) :— inf{t > : Zt > x} for x > 0. Then tq is a stopping time adapted 
to (J^f), and so {r > tq} G J^^^. Moreover, P(r > tq) > P(r > to) > 0, and 
P{Zr„ > 0) = P(Zt„ > 0) 1. Thus, the set {r > tq, Zr, > 0} lies in and 
has positive probability. On this set, 

P (0 < < xo\T^J > P (0 < Zt < xo for To < < < T| T^J > 0, 

by the strong Markov property of {Zt) and the fact that (Zt) behaves like 
Brownian motion with drift as long as it does not hit 0. But then 

P(0 <Zr<Xo)=E [P {0<Zr<Xo\ T^J] > 0, 

proving p.l4p . 

Next, a moment of reflection shows that Zt — Zf^^ if and only if Zt = 0. 
Thus, by (|3T4|) . 

P(Z-^ <Z^ < Xo) = P(0 <Z^ < Xo) > 0. 

Along with the fact that G{t, ■) is strictly decreasing on [0, xo] for all t > 0, this 
yields strict inequality in p.lOp . 

(ii) Consider next the case A > 0. Then strict inequality holds in Corol- 
lary [3T] for t > and all x. But this yields strict inequality in (|3.12[) above for 
any stopping time t with P(r < T) > 0. 
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(iii) Assume finally that A = 0, and / is not linear. By Lemma [??lT iii). strict 
inequality holds in (|3.2p for alH > and all a; > 0. Thus, for any stopping rule 
r such that P(M^ - > and r < T) > 0, 

E[DiT - T, Z^)] > E[G(T - r, Z^)], 

and so the equality in (|3.13p is replaced with "<". □ 
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